THE h- VECTOR OF A LADDER DETERMINANTAL RING 
COGENERATED BY 2x2 MINORS IS LOG-CONCAVE 



MARTIN RUBEY 



Abstract. We show that the /i-vector of a ladder determinantal ring cogener- 
ated by M = [u\ \ v\\ is log-concave. Thus we prove an instance of a conjecture 
of Stanley, resp. Conca and Herzog. 



In honour of Miriam Rubey, at the occasion of her second birthday 

1. Introduction 

Definition 1.1. A sequence of real numbers ai,a%, ■ ■ -,a n is logarithmically con- 
cave, for short log-concave, if cii_ia; + i < af for i 6 {2, 3, . . . , n — 1}. 

Numerous sequences arising in combinatorics and algebra have, or seem to have 
this property. In the paper written in 1989, Richard Stanley collected various 
results on this topic. (For an update see pjj.) There he also stated the following 
conjecture: 

Conjecture 1.2. Let R = Rq(BRx®. . . be a graded (Noetherian) Cohen- Macaulay 
(or perhaps Gorenstein) domain over a field K — Rq, which is generated by R\ and 
has Krull dimension d. Let H(R, m) = dim^ R m be the Hilbert junction of R and 
write 

s 

H(R, m)x m = (1 - x)- d ^2 hix\ 

m>0 i=0 

Then the sequence ho, hi, . . . , h s is log-concave. 

The sequence ho, hi, . . . , h s is called the h-vector of the ring. Orginally the 
question was to decide whether a given sequence can arise as the h- vector of some 
ring. In this sense the validity of the conjecture would imply that log-concavity 
was a necessary condition on the h- vector. 

It is now known however that Stanley's conjecture is not true in general. 

Several natural weakenings have been considered, but are still open. For example, 
Aldo Conca and Jurgen Herzog conjectured that the ^-vector would be log-concave 
for the special case where R is a ladder determinantal ring. (Note that ladder 
determinantal rings are Cohen-Macaulay, as was shown in Corollary 4.10], but 
not necessarily Gorenstein.) We will prove the conjecture of Conca and Herzog in 
the simplest case, i.e., where R is a ladder determinantal ring cogenerated by 2 x 2 
minors, see Corollary 14. 61 

In the case of ladder determinantal rings the h- vector has a nice combinatorial 
interpretation. This follows from work of Abhyankar and Kulkarni ^ EH \U\ > 
Bruns, Conca, Herzog, and Trung 0)0 El Ej- In the following paragraphs, which 
are taken almost verbatim from [H], we will explain these matters. 

l 
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2. Ladders, ladder determinantal rings and non-intersecting lattice 

PATHS 

First we have to introduce the notion of a ladder: 

Definition 2.1. Let X = (xij)o<i<b,o<j<a be a (b + 1) x (a + 1) matrix of inde- 
terminates. Let Y = (yij)o<i<b,o<j<a be another matrix of the same dimensions, 
with the property that y^ j G {0,Xi j}, and if y^j = Xij and yv .y = x# f, where 
i < i' and j < j' then y r _ s — x r)S for all r and s with i < r < i' and j < s < j'. 
Such a matrix Y is called a ladder. 

A ladder region L is a subset of Z 2 with the property that if and G £, 

i < i' and j > j' then (r, s) G L for all r G {i, i + 1, . . . , i'} and s G {j', j' + 1, . . . , j}. 
Clearly, a ladder region can be described by two weakly increasing functions L and 
L, such that L is exactly the set of points : L(i) < j < L(i)}. 

We associate with Y a ladder region L C Z 2 via (j, b — i) E L if and only if 
= / • 

In Figure ^a an example of a ladder with a — 8 and 6 = 9 is shown, the 
corresponding ladder region is shown in Figure ^b. 
Now we can define the ring we are dealing with: 

Definition 2.2. Given a (b+1) x (a+1) matrix Y which is a ladder, fix a "bivector" 
M = [ui, U2, ■ ■ ■ , u n | i>i, V2, ■ ■ ■ , w n ] of integers with l<ui<it2<---<lt„<6+l 
and 1 < Vi < V2 < • • • < V n < a + 1. By convention we set « n+ i = b + 2 and 
i; n+ i = a + 2. 

Let -ftT[Y] denote the ring of all polynomials over some field K in the yij's, where 
< i < b and < j < a. Furthermore, let 7m (Y) be the ideal in K [Y] that is 
generated by those t x t minors of Y that contain only nonzero entries, whose rows 
form a subset of the last Ut — 1 rows or whose columns form a subset of the last 
v t — 1 columns, t G {1, 2, . . . , n + 1}. Thus, for t = n + 1 the rows and columns of 
minors are unrestricted. 

The ideal 7m (Y) is called a ladder determinantal ideal generated by the mi- 
nors defined by M. We call 7?m(Y) = T4T[Y]/7m(Y) the ladder determinantal 
ring cogenerated by the minors defined by M, or, in abuse of language, the ladder 
determinantal ring cogenerated by M . 

Note that we could restrict ourselves to the case U\ = V\ = 1, because all the 
elements of Y that are in one of the last u\ — 1 rows or in one of the last V\ — 1 
columns are in the ideal. 

Next, we introduce the combinatorial objects that will accompany us throughout 
the rest of this paper: 

Definition 2.3. A two-rowed array of length k is a pair of strictly increasing se- 
quences of integers, both of length k. A two-rowed array T = (tlil ...it) i s 
bounded by A = (Ai,A 2 ) and E = (E ll E 2 ), if 

A\ < CL\ < 0,2 < ■ ■ ■ < &/c < El — 1 

and A 2 + 1 < fei < b 2 < ■ ■ ■ < b k < E 2 . 

Given any subset L oil? , we say that the two-rowed array T is in L, if (a^, bi) G L 
for i G {1, 2, ... , k}. By T^(A >— > E) we will denote the set of two-rowed arrays 
of length k, bounded by A and E which are in L. The total length of a family of 
two-rowed arrays is just the sum of the lengths of its members. 
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Let T\ = (bUl ... H ) an d T2 — ( yl yl :;; %\ ) be two-rowed arrays bounded by 
AW = {A^,A^) and - and = (4 2 \4 2) ) and # (2) = 

(E{ 2 \E^ 2) ) respectively. Set a k+1 = E^ and b = A^ . We say that T x and T 2 
intersect if there are indices I and J such that 

(x) xj<ai 

bi-i < yj 

where 1 < I < k + l and 1 < J < I. A family of two-rowed arrays is non-intersecting 
if no two arrays in it intersect. 

Note that a two-rowed array in T^(A 1— » E) can be visualized by a lattice path 
with east and north steps, that starts in A and terminates in E and has exactly 
k north-east turns which are all in L: Each pair (<Zj,&j) of a two-rowed array 
(till ... 6t ) then corresponds to a north-east turn of the lattice path. It is easy 
to see that Condition (xj holds if and only if the lattice paths corresponding to T\ 
and T 2 intersect. 

For an example see Figure^ ! where the three two-rowed arrays 

?)- rW = (2 9*" dr0, = (? t t) 

bounded by A^ = (0,3), A^ = (0,2), A^ = (0,0) and = (5,9), E^ = 
(7,9), = (8,9) are shown as lattice paths. The points of the ladder-region L 
are drawn as small dots, the circles indicate the start- and endpoints and the big 
dots indicate the north-east turns. 



x 0, gzo, 72:0,8 

0000 ePi,#>i, y>i, s 

x 2, 3^2, 4^2, 5^2, 6^2, 7^2, 8 

^3,23:3,33:3, 4^3, 5^3,6 

3:4, 2^4,31:4, 42:4, 5Z4,6 

3:5,23:5,33:5,43:5,53:5,6 

3:6,03:6,13:6,23:6,33:6,43:6,53:6,6 

3:7,03:7,13:7,23:7,33:7,43:7,5 

3:8,03:8,13:8,23:8,33:8,4 

3:9,03:9,13:9,23:9,33:9,4 

a. a ladder with a = 8 b. the corresponding c. a triple of non- 
and 6 = 9 ladder region intersecting lattice 

paths in this ladder 

Figure 1. 



3. A COMBINATORIAL INTERPRETATION OF THE /l-VECTOR OF A LADDER 

DETERMINANTAL RING 

We are now ready to state the theorem which reveals the combinatorial nature of 
the ft.- vector of .Rm(Y) = K [Y]/7m-(Y), the ladder determinantal ring cogenerated 
by M. 
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Theorem 3.1. Let Y = (yi,j)o<i<b, o<j<a be a ladder and let M — [ui, 112, ■ ■ . , u n \ 
V\, V2, ■ ■ ■ , v n ] be a bivector of integers with 1 < u\ < 112 < ■ ■ ■ < u n < a + 1 and 
1 < vi < V2 < ■ ■ ■ < v n < b + 1. For i G {1, 2, . . . , n} let 

A« = (0,u n +i-i-l) 

= (a -«„+!_< + 1,6). 

Let 7>> =L be the ladder region associated with Y and for i G {1, 2, . . . , n — 1} let 
L (l) = {(i,)/)£l ( ' +1) ■■x<E[ l \y>A i 2 l) and (x + 1, y - 1) G L^}. 

Finally, for i G {1, 2, . . . ,n} Zei 

fl« = {(x, j/) G L« : (z + 1, y - 1) £ L«}. 

and Ze£ d fee f/ie cardinality of\J"_ 1 B"' . 

Then, under the assumption that all of the points A^> and E^ l \ i G {1, 2, . . . , n}, 
lie inside the ladder region L, the Hilbert series of the ladder determinantal ring 
Rm(Y) =K[Y]/I m (Y) equals 

> d\m K FL M (Y)i>z = = — . 

e>o y ' 

Here, Rm{Y)i denotes the homogeneous component of degree £ in Rm(Y) and 
\T £ L (A i — s- E) I is the number of non-intersecting families of two-rowed arrays with 
total length £, such that the i th two-rowed array is bounded by and fiW and is 
in L(0 \£« fori G {1, 2, . . . ,n}. 

The sets 2?^, i 6 {1, 2, . . . , n} can be visualized as being the lower-right bound- 
ary of Viewed as a path, there are exactly E^ — A^ + E^ — A^ + 1 lattice 
points on flW, but not all of them are necessarily in L. However, if L is an upper 
ladder, that is, (a, 0) G L, then this must be the case and we have 

n 

d = j2 ( E i ] - A f + E 2 ] - 4° + 1) 

n 

= y, (a - v n+1 -i + 1 + 6 - itn+i-i + 1 + 1) 
1=1 

n 

= n(a + b + 3) - (ttj + ^) , 

as in PJ. 

In Figure |2Ja, an example for a ladder region L with a = 8 and 6 = 9 is given. 
The small dots represent elements of L, the circles on the left and on the top of 
L represent the points AW and E^ l \ i G {1,2,3} that are specified by the minor 
M = [1,3,4 I 1,2,4]. The dotted lines indicate the lower boundary of L w . Note 
that the point (4, 9) is not an element of L. Therefore, in this example we have 

n 

d = n{a + b + 3) - ^(m + Vi) - 1 = 44. 

i=l 
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a. a ladder region with a = 8 b. a 10 dimensional face of 
and 6 = 9 A [1j3i 4| 1i2 ,4] (Y) 

Figure 2. 
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FIGURE 3. Constructing a family of non-intersecting lattice paths, 
such that the i th path stays above L^ l \ i £ {1, 2, 3} 
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Figure 4. The corresponding family of non-intersecting lattice 
paths, where the i th path has north-east turns only in LW for 

ie {1,2,3} 
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Proof. We will use results of Jiirgen Herzog and Ngo Viet Trung. In Section 4 of 
[Hj, ladder determinantal rings are introduced and investigated. 

We equip the indeterminates Xij, i £ {0, 1, . . . , b} and j S {0, 1, . . . , a} with the 
following partial order: 

< x i',j' if « > «' and j < j'. 

A i-antichain in this partial order is a family of elements x ri ai , 2V 2 , S2 , . . . , x rt ,st such 
that r\ < r 2 < • ■ ■ < r t and si < s 2 < ■ ■ ■ < s t . Thus, a t-antichain corresponds to 
a sequence (si, b — ri), (s 2 , b — r 2 ), . . . , (s t , b — r t ) of t points in the ladder region 
associated with Y, where each point lies strictly south-east of the previous ones. 

Let D t be the union of the last u t — 1 rows and the last v t — 1 columns of Y. 
Let Am(Y) be the simplicial complex whose fc-dimensional faces are subsets of 
elements of Y of cardinality k + 1 which do not contain a i-antichain in Dt for 
t E {l,2,...,n+l}. Let fk be the number of /c-dimensional faces of Aa/(Y) for 
k > 0. Then, Corollary 4.3 of states, that 

dim K R M (Y) e = V f^" 1 )/*- 

In the following, we will find an expression for the numbers fk involving certain 
families of non-intersecting lattice paths. 

In Figure[21b, a 10-dimensional face of Am ,3,411,2,4] (Y) is shown, the elements of 
the face are indicated by bold dots. We will describe a modification of Viennot's 
'light and shadow procedure' (with the sun in the top-left corner) that produces a 
family of n non-intersecting lattice paths such that the i th path runs from A® = 
(0, it n -|_i_j) to — (a — u n _|_i_j,6) and has north-east turns only in LW, for 
i e {1,2, ...,n}. 

Imagine a sun in the top-left corner of the ladder region and a wall along the 
lower-right border of Then each lattice point (r, s) that is either in or 
corresponds to an element x St b- r of the face casts a 'shadow' {(x, y) : x > r,y < s}. 

The first path starts at A^\ goes along the north-east border of this shadow 
and terminates in In the left-most diagram of Figure this is accomplished 

for the face shown in Figure 0b. 

In the next step, we remove the wall on B^ and all the elements of the face which 
correspond to lattice points lying on the first path. Then the procedure is iterated. 
See Figure [3] for an example. Let P be the resulting family of non-intersecting 
lattice paths. 

Now, for each i € {1,2,..., n}, we remove all elements of the face except those 
which correspond to north-east turns of the i th path and do not lie on fiW, In the 
example, (5,8) is a north-east turn of the second path but lies on B^ 2 \ therefore 
the corresponding element £1,5 of the face is removed. On the other hand, (4, 5) 
lies on B^\ but is a nort-east turn of the third path, so the corresponding element 
2:4,4 of the face is kept. 

This set of north-east turns defines another family of non-intersecting lattice 
paths P 1 that has the property that the i th path has north-east turns only in LW 
for i G {1,2,.. .,n}. 

We now want to count the number of faces of Aa/(Y) that reduce under 'light 
and shadow' to a given family of lattice paths P' with this property. Clearly, P' 
can be translated into a family P of non-intersecting lattice paths such that the i th 
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path does not go below B^ 1 ' for i £ {1,2,..., n}. Note that the number of lattice 
points on such a family P of paths is always equal to d, independently of the given 
face. Thus, if m is the number of north-east turns of P', there are 

d — vfi 
. k + 1 — m , 



families of non- intersecting lattice paths P that reduce to P' . 

I d—m \ 



Hence, f k = ( k t^ ) \T e L (A i-> E)| and we obtain 



£dim K iMY)^ = £ (El 7 

e>o e>o ^k>o 



I - 1 \ ( K / d - m 



EE , E { k :V-J^ A "^h 

t>0 k>0 V 7 v m=0 v 

EI^( A - E )IE- £ E 



m>0 ^>0 fe>0 



I — 1\ / d — m 
d — k — 1 



and if we sum the inner sum by means of the Vandermonde summation (see for 
example |7j, Section 5.1, (5.27)), 



E dim* R M (Y),/ = E |^(A^E)|E 



Em>o\%n(A^E)\z™ 



d + l-m-1 
d-1 



{i-zY 



4. Log-concavity of the /i-vector in the case M = \u\ \ vt] 



a 



In this paper we will settle Stanley's conjecture when R is a ladder determinantal 
ring cogenerated by M , where M is just a pair of integers, i.e., n = 1. We want to 
stress, however, that data strongly suggest that Conca and Herzog's conjecture is 
also true for arbitrary n. 

By the preceding theorem, in the case we are going to tackle, the sum J^?_ hiX 1 
that appears in the conjecture is the generating function ^2 k>0 \ Ti^(A ^ E)\z k of 
two-rowed arrays bounded by A and E which arc in the ladder region L. 

As the bounds A and E will not be of any significance throughout the rest of 
this paper, we will abbreviate Tu {A i— > E) to Tu ' . We will show that the h- vector 
is log-concave by constructing an injection from T k , 1 x T£_ x into x This 
injection will involve some cut and paste operations that we now define: 

Definition 4.1. Let A and X be two strictly increasing sequences of integers, such 
that the length of X is the length of A minus two, i.e., A = {a%, a,2, ... , dk+i) and 
X = (xi, X2, ■ ■ ■ , x k -i) for some fc > 1. A cutting point of A and X is an index 
I € {1, 2, . . . , k} such that 

(*) ai < xi, 

and xi^i < ai + i, 

where we require the inequalities to be satisfied only if all variables are defined. 
Hence, 1 is a cutting point if a\ < x%, and k is a cutting point if Xk-i < afc+i- 
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The image of A and X obtained by cutting at I is 

ai a 2 ... a/_i a ; | xi xi +1 . . . Xk-i 

xi x 2 ... xi-i I a t+ i a /+2 a k+ i 



Note that both the resulting sequences have length k. 

Lemma 4.2. Let A = (ai, 0,2, . ■ ■ , dk+i) and X = [xi, X2, ■ ■ ■ , Xk-i) be strictly 
increasing sequences of integers, such that the length of X is the length of A minus 
two. Then there exists at least one cutting point of A and X. 

Proof. If ai > xi for I 6 {1, 2, . . . , k — 1} then a k +i > ak~i > Xk~i and k is a cutting 
point. Otherwise, let I be minimal such that aj < X\. If I = 1 then 1 is a cutting 
point. Otherwise, because of the minimality of I, we have a; +1 > a;_! > thus 
I is a cutting point. □ 

Definition 4.3. Let T = (Ti,T2) 6 Tk+i x T~k-i be a pair of two-rowed arrays. 
Then a top cutting point of T is a cutting point of the top rows of T\ and T2 and a 
bottom cutting point of T is a cutting point of the bottom rows of Ti and T 2 . 

A pair (I, m), where I, m 6 {1, 2, . . . , fc}, such that I is a top cutting point and 
to is a bottom cutting point of T\ and T2 is a cutting point of T . Cutting the top 
rows of T at / and the bottom rows at m we obtain the image of T . Note that both 
of the two- rowed arrays in the image have length fc. More pictorially, if I < m, 

ai ai xi x m -i x fe _i 

b\ bi + i b m y m ... y fc _i 

Xi ... a; + i .... a m afe+i 

2/i yi Vm-x b m+ i bk+i, 

and similarly if I > to. 

For T = (Ti,T 2 ) £ x ^k-\i ^ ne P a ^ r Q> m ) ^ s an allowed cutting point ofT, 

if both of the two-rowed arrays in the obtained image are in L. 

In Lemma 15. II we will prove that every pair of two-rowed arrays in T k L +1 x T l f J _ 1 
has at least one allowed cutting point. This motivates the following definition: 

Definition 4.4. Let T = (T l5 T 2 ) £ T k L +1 x T k L _ 1 a pair of two-rowed arrays as 
before. Consider all allowed cutting points (T, to) of T. Select those with \l — to| 
minimal. Among those, let (I, to) be the pair which comes first in the lexicographic 
order. Then we call (l,m) the optimal cutting point of T. 

Now we are ready to state our main theorem, which implies that Stanley's con- 
jecture is true, when R is a ladder determinantal ring cogenerated by a pair of 
integers M: 

Theorem 4.5. Let L be a ladder region. Let T e T k L +1 x T£_ v Define L(T) to 
be the pair of two-rowed arrays obtained by cutting T at its optimal cutting point. 
Then L is well-defined and an injection from T k L +1 x T k L _ 1 into T k L x T k L . 

Corollary 4.6. The h-vector of the ladder determinantal ring cogenerated by M = 
[ui I v{\ is log-concave. 

Proof of the corollary. By Theorem 13.11 the h- vector of this ring is equal to the 
generating function ^2 k>0 \ T k {A 1— > E) \ z k of two-rowed arrays bounded by A — 
(0, Ui — 1) and E = (a — V\ + 1, b) which are in the ladder region L. By the 
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preceding theorem, there is an injection from T k L +1 (A i— » E) x T£_ X (A \— > _E) into 
T fc L (A i-> £7) x 7^ (A i-> £), thus 



i * £0| ' % L -M " 25)| < \T k \A ^ E)\ 



□ 



We will split the proof of Theorem l4.5l in two parts. In SectionElwe show that the 
mapping I is well-defined, that is, for any pair of two-rowed arrays T G T k+ i x T£_ x 
there is an allowed cutting point. Finally, in Section|51 we show that I is indeed an 
injection. 

5. The mapping I is well-defined 

Lemma 5.1. Let L be a ladder region. Then for every pair of two-rowed arrays in 
1~k+i x there is an allowed cutting point (l,m). 

For the proof of this lemma, we have to introduce some more notation: Let 
( Tl ,T 2 ) G T& x xTt, with T X = C; Z : ZX\) and T 2 = (£ - %tz\). We say 
that Inequality |fop| holds for an interval [c, d] if 

(top) £(aj) > Uj-i, 

for j G [c, d] . Inequality \top\ holds for an interval [c, d] if 

{ top ) L(aj)<yj-i, 

for j G [c, d] . Similarly, Inequality \bottom\ holds for an interval [c, d] if 



(bottom) L(xj~i) > bj, 

for j G [c,d]. Inequality \bottom\ holds for an interval [c, d] if 

( bottom ) L(xj—i) < bj, 

for j G [c, cf| , where L and L are as in Definition 12.11 We say that any of these 
inequalities holds for a cutting point (l,m) if it holds for the interval [I + l,m] if 
I < m and for the interval [m + 1,1] if m < I. Clearly, a cutting point (l,m) is 
allowed if and only if all of these inequalities hold for it. 
Most of the work is done by the following lemma: 

Lemma 5.2. Let T = (Ti,T 2 ) G T k L +1 x T k L _ 1 , Ti = Q T 2 Z ) and T 2 = 
\yl vl ■■■ Vk-l )• Let I and I be top cutting points, such that there is no top cutting 
point in the closed interval [1 + 1,7— 1]. Similarly, let m andm be bottom cutting 
points, such that there is no bottom cutting point in the closed interval [m+l,m— 1], 
Then for both of the intervals [1 + 1,7] and [m + 1, m] , 
• either { topi or ibottomi hold, 
top\ or \bottom\ hold, 
topi or ]top y hold, 
bottom\ or \bottom\ hold. 
Let l m i n , Imaxi ^min & n d ^max be the minimal and maximal top and bottom cutting 
points. Then we have 



either 

• either 

• either 



topi an d (feottorol hold for [2, max(l m im m m i n )] and 
topi and ibottoml hold for [mm(l max ,m max ),k]. 
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Proof. Suppose that \top\ does not hold for the interval \l + 1,2]. We claim that in 
that case there is an index j G [2 + 1,2 — 1] such that a,j < x.y. For, by hypothesis 
there is an index i 6 [2 + 1,1} such that L(a,i) < yi-x- We have L(ai) < yi~\ < 
L(xi^i) and because L is a weakly increasing function, < It follows that 

a^-i < a,i < Xi-i < Xi. Thus, if i = 2 we choose j = i — 1, otherwise j = i. 

The same statement is true if ( |6ottom| | does not hold for the interval [7 + 1,1]: In 
this case there must be an index i G [1 + 1,1] such that L(xi-i) > bi. We conclude 
that L(cii) < bi < L(x,i-i) and thus < Xi-x. 

Next, we will use induction to prove that 

(**) ai < xi 

and a/+i < xi-i 

for 2 G [1+1,1—1]. We will first do an induction on I to establish the claim for 

We start the induction at 2 = j: Above we already found that cij < Xj. Therefore 
we must have flj+i < a^j-i, because otherwise j would satisfy Q and hence were a 
top cutting point. 

Now suppose that holds for a particular I < I — 1. Then a; + i < < 
and, because there is no top cutting point at I + 1, we have a; + 2 < a;;- 

Similarly, to establish fiTj) for / G [2 + 1, j] we do a reverse induction on I. Suppose 
that fi^l holds for a particular I > {+ 1. Then a;_i < a/+i < and, because 

there is no top cutting point at I — 1, we have a; < xi-2- 

Thus we obtain 

L(xj_ 1 ) > L(xj_ 2 ) > L(aj) > bj, and 
L(xi-\) > L(ai+i) > k + i > k, 

which means that \bottorn\ holds for the interval [1+ 1,1]. 
Furthermore, 

Mfli+i) < L(ai +2 ) < L(x{) < yy and 
Mfli) < L(xi- 2 ) < yi-2 < Vi-x, 

which means that ^top^ holds for the interval [Z + 1,1]. 

Next we show that \top\ and §pottom\ hold for the interval [2, Z TO , n ]: Assume 
that either of these inequalities does not hold for the interval [2, l m in] and that 
[2, l m in\ does not contain a top cutting point except l m in- Then the above reverse 
induction implies that a\ < < x\, which means that 1 is a top cutting point. 
Thus, l rn in = 1 and the interval [2, l m i n ] is empty. 

The other assertions are shown in a completely analogous fashion. □ 

We are now ready to establish Lemma f5. II 

Proof of LemmaFjll Let T = (Tx, T 2 ) G T k L +1 x T k L _ 1 . By Lemma IO there is at 
least one cutting point (l,m) of T. Let l m in, Imax, m-min and m max be the minimal 
and maximal top and bottom cutting points of T as before. 

If there is an index j which is a top and a bottom cutting point of T , then 
- trivially - is an allowed cutting point. Othe rwise, w e have to show that 

there is a cutting point (l,m) for which \top\ , {top), \bottom\ . and \bottom\ hold. 
Suppose that this is not the case. 
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For the inductive proof which follows, we have to introduce a convenient indexing 
scheme for the sequence of top and bottom cutting points. Let 

mi o = max{m : m < l m in and m is a bottom cutting point}, 
m i,o = max{m : m < h-1.1 and m is a bottom cutting point} for i > 1, 
and h.o = max{7 : I < m^i and / is a top cutting point} for i > 1, 

where m i j+1 is the bottom cutting point directly after rrii j, and i-y+i is the top 
cutting point directly after kj. Furthermore, we set Zo,i = lmin- 

More pictorially, we have the following sequence of top and bottom cutting points 
for i > 1: 

• • ■ < m ifi < k-is < /i_i j2 < • • • < hfi < m^i < rrii^ < ■ ■ ■ < m i+lfi <■■■ 

mi,o does not exist, of course. Note that there are no bottom 
cutting points between Z^i and h+ifij & n d there are no top cutting points between 

m iA and mj+i.o- 

Suppose first that m min < l m i n . By induction on i, we will show that \top\ 



and \bottom\ h old f or the cutting points (Z»— 1,1,771^0), where i > 1. By Lemma 15.21 
we know that \top\ and loottoml) are satisfied for the cutting point (l m in: ni 1,0): 
because [m^o + 1, Zmin.] Q [2, f m m]- It remains to perform the induction step, which 
we will divide into five simple steps. 

Step 1. \top\ and \bottom\ hold for the interval [m^ p + 1, 1,1] - This is just a 

restatement of the induction hypothesis, i.e., that jtop| and \bottom\ hold for the 
cutting point m^o)' 

Stop S. Either I bottom! or (jtopj^jioe^ not hold for the interval [7774,0 + l,77ii,i]. 

Because of Step 1, not both of fooftomjl and (jtop|^an hold for (Z^ 1,1 , mi.o), lest 

this was an allowed cutting point. Thus eit her foottom| or Uopl does not hold for 

1 m^o + l , Zi— i,o+l]- This interval is contained in [m^o + L m i,i\i thus the inequalities 
Ibottomj l and (topi cannot hold on this interval either. 

Step 3. {top) and \bottom\ hold for [lift + 1,777^1]. Suppose t hat \bottom^ does 
not hold for [m^o + Lmi.i]- Then, by Lcmma l5.2l we obtain that \top\ and \bottom\ 
hold for [m^o + ljTi^i], because this interval contains no bottom cutting points 
except m^i. The same is true, if \top\ does not hold for [777,4,0 + 1,777^1]. Because 
[lift + 1,771^1] is a subset of this interval, \top\ and \bottom\ hold for the cutting 
point (lifl,rm,i), or, equivalently, for the interval [U t o + 1,777^1]. 

Step 4- Either \bottom\ or §top\ does not hold for [Zj,o + L^.i]- Because of 
Step 3, not both of \bottom\ and Qtop [) can hold for the cutting point (Zj ; o, 77ii,i), 
nor for the greater interval [Z^q + 1, /*,aj - 

Step 5. \top\ and \bottom\ hold for [m.^+i o + l,Zj,i]. The interval [I^q + l,Zi,i] 
does not cont ain a top cutting point except Zj,i, thus by Lemma 15.21 and Step 4 we 
see that (| top| and Ibottoml ) hold. Finally, because [777^+1,0 + L^i] C [Z^o + l,^.i], 
\top\ and \bottom\ hold for the cutting point (li t \,Tn%+ifi). 

If Imax > rn max , then we encoun ter a contradiction: Let r be such that 777 r ,o = 
m max- We have just shown that \top\ and j&oitoml) hold for the cutting point 
(Zr-1,1, rn r .o). Furthermore, by Lemma [5.21 \bottom\ and itopl hold for [m ri o,k] 
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and thus also for (Z r -i,i, fn r ,o). 
contradicting our hypothesis. 



Hence, this would be an allowed cutting point, 



If lr 



let r be such that L 



Imax- By the induction (Step 3) we 
find that [top) and \bottom\ hold for the cutting point (l r ^ 7 m r ^). Again, because 
of Lemma 15.21 we know that ]fbottom\ and Qtop| ) holds for [l r .0i k] and thus also for 
(l r fi, m rt x). Hence, we had an allowed cutting point in this case also. 

The case that mi > l\ is completely analogous. □ 

6. The mapping I is an injection 
Lemma 6.1. The mapping I defined above is an injection. 

Proof. Suppose that J(T) = I(T) for T = (T u T 2 ) and T = (T{, Tfi, such that T 
and T" are elements of T k L +1 x T^—x- Let (l,m) be the optimal cutting point of T, 
and let (Z',to') be the optimal cutting point of T". 

Observe that we can assume min(i, m, V , to') = 1, because the elements of T and 
T' with index less than or equal to this minimum retain their position in I(T). 
Likewise, we can assume that max(Z, to, I' , to') = k. 

Furthermore, we can assume that I < I', otherwise we exchange the meaning of 
T and T". Thus, we have to consider the following twelve situations: 



(1) 


1 




< 


V 


< 


rn 


< 


rn' 


= k 


(2) 


1 




< 


V 


< 


rn' 


< 


rn 


= k 


(3) 


1 




< 


rn 


< 


V 


< 


ml 


= k 


(4) 


1 




< 


rn 


< 


rn' 


< 


V 


= k 


(5) 


1 




< 


rn' 


< 


V 


< 


m 


= k 


(6) 


1 




< 


rn' 


< 


m 


< 


V 


= k 


(7) 


1 


= m 


< 


I 


< 


V 


< 


m! 


= k 


(8) 


1 


— TO 


< 


I 


< 


rn' 


< 


V 


= k 


(9) 


1 


= TO 


< 


rn' 


< 


I 


< 


V 


= k 


(10) 


1 


= to' 


< 


I 


< 


V 


< 


m 


= k 


(11) 


1 


= to' 


< 


I 


< 


m 


< 


V 


= k 


(12) 


1 


= to' 


< 


rn 


< 


I 


< 


V 


= k 



We shall divide these twelve cases into two portions according to whether I < to or 
not. 

A: 1 < m. In the Cases (l)-(6), (10) and (11) we have I < to, thus the pair of 
two-rowed arrays T = (Ti,r 2 ) G T h L +1 x T k L _ x looks like 



Ol 

bi 



ai | ai + i 



afc+i 
h+i 



Xl-l | Xl 



Xl 

Vl Vm-X I Un 

Cutting at (l,m) we obtain I(T) G x T k L : 

ai I xi 



Xk-l 
Vfe-l- 



«1 

bi 



Un 



Xk-l 
Vk-1 



xi-i | a;+i 



Ofe+l 

bk+i- 



Xl 

Vl Vm-l I b m+ i 

If I = 1, then the top row of the second array in I(T) is (02, 03, ... , au+i), if to = fc, 
then the bottom row of the first array in I(T) is (61, 62, • ■ ■ , bk)- 
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Case (1), 1 = 1 < 1' < m < m' = k. Given that I(T) = I(T'), the pair V can be 
expressed in terms of the entries of T as follows: 



(r 



Ol I Xi 

h ... 



Xv-i : ai>+i 



Vn 



Ofe+1 

Vk-x \ h+i 



av 



Xk-l 

bk 



I a 2 

2/1 Urn-l \ b m+ l 

The vertical dots indicate the cut (l',m') which would result in I(T'). We show 
that the cutting point (I, to) = (l,m), indicated above by the vertical lines, is in 
fact an allowed cutting point for T': Cutting at (1, to) yields 



(T) 



h ... 



av 



Xm — l 
bin 



"ro+1 



Xk-l 
bk 



Xl'-l : O/' + i 



Ofc+1 



J/i Um-1 I 2/m Vk-l 

Note, that this is the same pair of two-rowed arrays we obtain by cutting T at 
(/', to'). We have to check that the pair of two-rowed arrays 10 is in the ladder 
region. 
Clearly, 

(02,62), (03,63), ■ ■ ■ , (av,bv) and (aci,2/i), (02,62), ■ ■ ■ , (acj'-i,^'-i) 

are in the ladder region, because these pairs appear also in T . Furthermore, the 
pairs 

(xv,bv + i), {xv+x,bv+2), ■ ■ ■ (x m -i,bm) 
and (av +1 ,yv), (av +2 ,yv+i), ■ ■ ■ (a m ,y m -i) 
appear in I(T) and are therefore in the ladder region, too. All the other pairs, i.e., 
(ai,6i) and {x m ,b m+1 ), (x m+ i, b m+2 ), . . . , (x k -i,b k ), 
(flm+ii Vm), (a m +2, y m +i), ■ ■ ■ , (ofe, Vk-i) and (afc+i, 6fe+i), 

are unaffected by the cut and appear in T". 

Thus we have that (Z, m) and (Z', to') are allowed cuts for T and T". We required 
that (l,m) is optimal for T and that (l',m') is optimal for T', therefore we must 
have I = V and to = to'. 

In all the other cases the reasoning is very similar. Thus we only print the pairs 
of two-rowed arrays T' and T and leave it to the reader to check that T is in the 
ladder region. 
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Case (2), 1 = 1 < 1' < m' < m = k. The pair T' can be expressed in terms of the 
entries of T as follows: 



(T>) 



oi | x-i 
h ... 



bm' I Vn 



Ofe+1 

2/fc-l | b k+1 



«2 
2/1 



ay : X;' 



2/m'-l I fcm' + l 



Xfe-l 



Cutting at (l,m) yields 



(T) 



ai | a 2 
6i ... 



Xk-1 

2/fc-i 



yi 



Xl'-l : a r + i 



<W flfc+1 

Z/m'-l I fcm' + l • • ■ bk b k +l- 



Case (3), 1 = 1 < m < 1' < m' = k. The pair T' can be expressed in terms of the 
entries of T as follows: 



(T>) 



ai | x-i xi'-i i a v+ i 

b\ b m | y m 



flfe+i 

Vk-i | fefe+i 



a 2 

2/1 • ■ 2/m-l | &m+l 

Cutting at (7, to) yields 



Xk-l 

bk 



(f) 



h ... 



a;/ : X V 



brn | &m+l 



Zfc-1 

b k 



xi xv-i j az'+i afc+i 

2/i ■ ■ 2/m-l | 2/m 2/fc-i ! bk+i- 



Case (4), 1 = 1 < m < m' < 1' = k. The pair T' can be expressed in terms of the 
entries of T as follows: 



a\ \ x\ ; a k+ i 

bi b m | y m ... y m '_i i & m '+i b k +i 



a 2 



2/1 • • 2/m-l I frm+i • ■ ■ b m , I y n 
Cutting at (7, to) yields 



a-k 
Vk-\- 



(T) 



ai | o 2 

&! ... 



b m +i b. m i \ y„ 



ak 
Vk-i 



xi 

2/1 • • 2/m-l | 2/r, 



Xk-i ; a/c+i 

2/m'-l I &m' + l fefe+1- 



15 



Case (5), 1 = 1 < m' < 1' < m = k. The pair T' can be expressed in terms of the 
entries of T as follows: 



(T>) 



ai \ Xi i a v+1 

h b m > \y m , 



flfe+i 

Vk-i I b k+1 



»2 av \ xi> x k -i 

yi ■ ■ Dm'-\ \ b m '+i h |. 



Cutting at (l,m) yields 



(T) 



ai | a 2 
h ... 



av : x v 



b m > ! y 



Xk-l 

yk-i 



Xl 



Xl'-l : aj'+l 



yi ■ ■ y m '-i i &m'+i 



• • • ftfe+i 
fefe I frfc+i- 



Case (6), 1 = 1 < m' < m < 1' = k. The pair T' can be expressed in terms of the 
entries of T as follows: 



(T>) 



<*i | £i ! a k+1 

bi b m i i y m / . . . y m -i \ b m +i b k +i 



a 2 a k 

yi ■ ■ y m '-i ! b m , + i ... b m | j/m y/c-i- 

Cutting at (^rn) yields 

«i I «2 a fe 

fri fem' j y m > ■ ■ ■ y m -i I y m yu-i 



(T) 



xi 

yi 



J/m'-l ! b m > + i 



Jm | ^m+l 



#fc-i ; dfc+i 
fefe+i- 



Case (10), 1 = m' < 1 < 1' < m = k. The pair T" can be expressed in terms of 
the entries of T as follows: 



ai a ; | x ; . . a;;'_i ! av +1 a k+ i 

h I yi 2/fc-i | bfc+i 



£i 
&2 



a;/-i I «;+i 



£fc-i 



Cutting at (l,m) yields 
(f) 



ai a; | a ;+ i 

h \ yi 



av \ xi 



Xh-l 

Vk-i | 



xi . . xi .... xv-i ! a// + i a k+ i 

b 2 b k \ b k +\. 
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Case (11), 1 = m' < 1 < m < 1' = k. The pair T" can be expressed in terms of 
the entries of T as follows: 



(T>) 



ax ... 

b i \ Vi 



ai | xi x k -\ ; a k+1 

Um-i I b m+ i bk+l 



Xi 

b 2 



xi-i | ai+i 



J m | Dm 



Vk-i- 



Cutting at (l,m) yields 
(T) 



oi ^ I a;+i 

&1 ! 2/1 2/m-l I V-n 



Vk-i 



X\ ■ ■ Xl-l | XL Xfe_i : a fe+ i 

^2 b m I & TO+ i frfc+i- 

B: m < 1. In the Cases (7)-(9) and (12) we have m < I, thus the pair of two-rowed 
arrays T = (T U T 2 ) € Tf +1 x T h L _ x looks like 



ai 



Jm | »m+l 



ai I ai+i a/c+i 

frfc+i 



x\ x\-\ \ xi .... x fe _i 

yi ... y m _i | y m y k -i. 

Cutting at (l,m) we obtain I(T) G T fc L x T fe L : 



ai 
&i 



a/ a;; 



J m | ym 



Xk-1 

Vk-i 



xi 

yi •■■ y m -i | &m+i 



| ai + i a k+ i 

bk+i- 



Case (7), 1 = m < 1 < 1' < m' = k. The pair T" can be expressed in terms of the 
entries of T as follows: 

a\ ai | xi . . xv -i I av+i a k+ \ 

h | 2/1 yk-\ \ h+i 



(T') 



fc 2 



xi-i | a i+ i 



aj' ; xv 



Xk-l 

bk 



Cutting at (l,m) yields 



(T) 



ai a; | a ;+ i 

&i I b 2 



av \ 



Xk-l 

bk 



x\ . . xi-i | xi xv-i j av+i a k+ i 

Vi Vk-i \ bk+i- 
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Case (8), 1 = m < 1 < m' < 1' = k. The pair T' can be expressed in terms of the 
entries of T as follows: 



(T>) 



a x ... 

bi I 2/1 



ai \ xi x k -\ i a k+1 

bk+i 



Xi . . xi^i | a l+1 

h b m > \ y„ 



2/fc-i- 



Cutting at (l,m) yields 



(T) 



ai ai | ai+i 

h | b 2 b m > \ y„ 



Vk-l 



Xl ■ ■ Xl-l I XI j a k+1 

Vl Vm'-l \ bm'+l bk+1- 



Case (9), 1 = m < m' < 1 < 1' = k. The pair T" can be expressed in terms of the 
entries of T as follows: 



ai 



(T') 



b\ | yi ... y m '-i : b 



m'+l 



a/ | a:/ x fe _i i a k +i 

bk+i 



Xl 

b 2 



xi-i | a l+ i . . a k 
Vk-i- 



bjn' I Vm' 

Cutting at (l,m) yields 

ai a; | a l+ i 



(T) 



&i | 62 b m i I y m 



afe 
J/fc-i 



Xl-l I X/ 



I 2/1 ■ ■ Vm'-l ! &m' + l 



a;fe-i \ a k +i 
bk+i- 



Case (12), 1 = m' < m < 1 < 1' = k. The pair T" can be expressed in terms of 
the entries of T as follows: 



ai 



(T') 



h I 2/1 ••■ 2/m-l I & 



'm+1 



a/ I x k -i \ a k+ i 

b k +i 



xi 
b 2 



xi-i I ai+i 



bra I Vn 

Cutting at (7, to) yields 



ak 
Vk-l- 



(f) 



ai a ; I a t+1 

h \ 2/1 •■• 2/m-l I 2/m 



afe 
2/fe-i 



&2 



Xl-l I 



y?n I Cm+1 



Sfe-i ; afc+i 
bfc+i- 



□ 
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